Exploring Low Cost Non-Contact Detection of Biosignals for HCI

In an effort to make biosignal integration more accessible to explore for more HCI researchers, this paper presents our investigation of how well a standard, near ubiquitous webcam can support remote sensing of heart rate and respiration rate across skin tone ranges. The work contributes: how the webcam can be used for this purpose, its limitations, and how to mitigate these limitations affordably, including how the skin tone range affect the estimation results.Comment: 10 pages, 5 figure

TASK INTEGRATED STRATEGIES FOR VIGILANCE ENHANCEMENT IN NATURALISTIC ENVIRONMENTS

Ph.DDOCTOR OF PHILOSOPH

EEG and eye tracking demonstrate vigilance enhancement with challenge integration

Maintaining vigilance is possibly the first requirement for surveillance tasks where personnel are faced with monotonous yet intensive monitoring tasks. Decrement in vigilance in such situations could result in dangerous consequences such as accidents, loss of life and system failure. In this paper, we investigate the possibility to enhance vigilance or sustained attention using ‘challenge integration’, a strategy that integrates a primary task with challenging stimuli. A primary surveillance task (identifying an intruder in a simulated factory environment) and a challenge stimulus (periods of rain obscuring the surveillance scene) were employed to test the changes in vigilance levels. The effect of integrating challenging events (resulting from artificially simulated rain) into the task were compared to the initial monotonous phase. EEG and eye tracking data is collected and analyzed for n = 12 subjects. Frontal midline theta power and frontal theta to parietal alpha power ratio which are used as measures of engagement and attention allocation show an increase due to challenge integration (p < 0.05 in each case). Relative delta band power of EEG also shows statistically significant suppression on the frontoparietal and occipital cortices due to challenge integration (p < 0.05). Saccade amplitude, saccade velocity and blink rate obtained from eye tracking data exhibit statistically significant changes during the challenge phase of the experiment (p < 0.05 in each case). From the correlation analysis between the statistically significant measures of eye tracking and EEG, we infer that saccade amplitude and saccade velocity decrease with vigilance decrement along with frontal midline theta and frontal theta to parietal alpha ratio. Conversely, blink rate and relative delta power increase with vigilance decrement. However, these measures exhibit a reverse trend when challenge stimulus appears in the task suggesting vigilance enhancement. Moreover, the mean reaction time is lower for the challenge integrated phase (RT mean = 3.65 ± 1.4 secs) compared to initial monotonous phase without challenge (RT mean = 4.6 ± 2.7 secs). Our work shows that vigilance level, as assessed by response of these vital signs, is enhanced by challenge integration

The Oesophageal cancer multidisciplinary team: can machine learning assist decision‑making?

BackgroundThe complexity of the upper gastrointestinal (UGI) multidisciplinary team (MDT) is continually growing, leading to rising clinician workload, time pressures, and demands. This increases heterogeneity or ‘noise’ within decision-making for patients with oesophageal cancer (OC) and may lead to inconsistent treatment decisions. In recent decades, the application of artificial intelligence (AI) and more specifically the branch of machine learning (ML) has led to a paradigm shift in the perceived utility of statistical modelling within healthcare. Within oesophageal cancer (OC) care, ML techniques have already been applied with early success to the analyses of histological samples and radiology imaging; however, it has not yet been applied to the MDT itself where such models are likely to benefit from incorporating information-rich, diverse datasets to increase predictive model accuracy.MethodsThis review discusses the current role the MDT plays in modern UGI cancer care as well as the utilisation of ML techniques to date using histological and radiological data to predict treatment response, prognostication, nodal disease evaluation, and even resectability within OC.ResultsThe review finds that an emerging body of evidence is growing in support of ML tools within multiple domains relevant to decision-making within OC including automated histological analysis and radiomics. However, to date, no specific application has been directed to the MDT itself which routinely assimilates this information.ConclusionsThe authors feel the UGI MDT offers an information-rich, diverse array of data from which ML offers the potential to standardise, automate, and produce more consistent, data-driven MDT decisions

Robot Capability and Intention in Trust-based Decisions across Tasks

10.1109/HRI.2019.867308414th ACM/IEEE International Conference on Human-Robot Interaction (HRI)2019-March, 22 March 201939-4

Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer

Background: rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables.Methods: retrospective complete-case analysis of oesophagectomy patients ± neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model.Results: we identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32–83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [±0.045] vs 0.757 [±0.068], 0.740 [±0.042], and 0.709 [±0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p &lt; 0.05).Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future